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(54) Multi-channel signal separation using cross-polyspectra. 



(57) A signal processing system includes a plurality of detectors for detecting signals, each detector 
receiving signals from plural sources ; and a processor for receiving the detected signals and producing 
a reconstruction filter for filtering the detected sigals to produce reconstructed source signals in which 
each source signal is reconstructed without interference from the other source signals. The reconstruc- 
tion filter is produced such that cross-poiyspectra of the reconstructed signals are forced to approach 
zero. 
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Background of the Invention 

The problem of separating two or more signals that are superimposed on each other arise in many signal 
processing applications. A classical example is the problem of enhancing a desired speech signal in the pres- 
5 ence of interference, or separating competing speakers using multiple microphone measurements. Another ex- 
ample is the problem of detecting a signal in the presence of directional interference, or detecting and localizing 
several spatially separated sources, by simultaneous observation of their signals using a spatially distributed 
array of receivers. Since the source signals as well as the transmission channel that couples the signals to 
the receivers are generally unknown, the problem of decoupling and identifying the two can not be solved un- 
to less we make some simplifying assumptions. In many cases of interest the channel can be modeled as a stable 
linear time invariant (LTI) system, and since the signals are generated by different sources we may also assume 
that they are statistically independent. The question is then whether these assumptions are sufficient for sep- 
arating and recovering the source signals. 

A recent series of papers (1) - C. Jutten, and J. Herault, "Blind separation of sources, part I: An adaptive 

15 algorithm based on neuromimetic architecture," Signal Processing, vol 24, No. 1, pp 1-10, July 1991, (2) - P. 
Comon, C. Jutten, and J. Herault, "Blind separation of sources, part II: Problems statement," Signal Processing, 
vol 24, No. 1, pp 11-20, July 1991, and (3)- E. Sorouchyari, C. Jutten, and J. Herault, "Blind separation of sourc- 
es, part III: Stability analysis," Signal Processing, vol 24, No. 1, pp 21-29, July 1991, consider the problem of 
source separation for the special case in which the observed signals at each point in time are given by unknown 

20 but fixed linear combinations of the source signals (i.e. the unknown channel is a constant gain matrix). These 
papers contains several important observations. 

First, it is pointed out that for the purpose of source separation it may be sufficient to assume that the 
signals are statistically independent. No additional information concerning the stochastic nature of each of the 
sources signals is required. To separate the sources it is then suggested to try and make the recovered signals 

25 statistically independent. However, tests for statistical independence are generally complicated, and require 
prior assumptions concerning the underlying probability distribution of each of the signals. Therefore, to solve 
the problem it is suggested to use an objective function consisting of high order statistics of the reconstructed 
signals, and then apply an algorithm to minimize that objective. If the algorithm converges, then at the point 
of convergence it attempts to minimize the correlation between some pre-specified non-linear functions of the 

30 reconstructed signals computed at the same sampling instance. Lack of correlation between non-linear func- 
tions of samples of the reconstructed processes is a weaker condition than statistical independence between 
samples of the processes, which is a weaker condition than statistical independence between the entire proc- 
esses. However, because of the simplified channel model, it is a sufficient condition for signal separation. In 
fact it can be shown that decorrelating the reconstructed signals at the same sampling time is also sufficient 

35 in this case (not as stated in paper (I) above). 

Patent Application Serial No. 07/750.917, filed August 28, 1991 by E. Weinstein (one of the joint inventors 
in the present application), M. Federand A.V. Oppenheim, for "Multi-Channel Signal Separation ", assigned to 
Massachusetts Institute of Technology, (unpublished), considers the more general problem in which the chan- 
nel is modeled as multi-input-multi-output (MIMO) LTI system. In the above patent application, it is suggested 

40 to separate and recover the input (source) signals by imposing the condition that the reconstructed signals 
be statistically uncorrelated. As it turns out, the decorrelation condition is insufficient to uniquely solve the prob- 
lem, unless we make certain assumptions concerning the unknown channel, e.g. that it is a MIMO finite impulse 
response (FIR) filter. 

For simplicity we shall concentrate specifically in the two channel case, in which we observe the outputs 
45 of an unknown 2x2 system, from which we want to recover its input signals. However we note that all the 
analysis and results can easily be extended to the more general case. In the two channel case it is desired to 
estimate the two source signals s,[n] and s 2 [n], from the observation of the two output signals y^[n] and y 2 [n]. 
In some applications one of the signals, s A [n] is the desired signal, while the other signal, s 2 [n], is the inter- 
ference or noise signal. Both the desired and the noise signals are coupled through an unknown system to 
so form the observed signals. 

Mathematical Preliminaries. 

A. Linear Systems 

55 

A stable single-input single-output (SISO) linear time invariant (LTI) system is characterized by its unit sam- 
ple response h[n], or by its transfer function (also called frequency response) H(iv), defined as the Fourier trans- 
form of h[n]: 
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n 

where 2 n denotes summation over all possible values of n. The output y[n] of an LTI system is related to its 
input s[n] by: 



y[n] = s[n]oy[n] = X) f i'M 71 ~ 'l 



where "o H denotes the convolution operation. 

A stable multi-input multi-output (MIMO) LTI system is also characterized by its unit sample response, or 
by its transfer function (also called frequency response). For example, a two-input two-output stable LTI system 
is characterized by its 2 x 2 unit sample response matrix: 



h[n) = 



h\i[n] /in[n] 
h 2i [n] h 22 [n) 



where fy{n] ij = 1 ,2 are the unit sample response of SI SO LTI systems. The transfer function of a 2 x 2 system 
is: 



Ww) = 



H xl (w) H l2 {w) 
H 2i (vj) H 22 {w) 



where H fJ {w) ij~ 1,2 are the Fourier transforms of h i} [n] ij~ 1, 2, respectively. 

The outputs yf[n] and y£n] of a 2 x 2 LTI system are related to its inputs s ? [n] and sjn] by: 

yAn] = hiMosM + h, 2 [n]os 2 [n] 
yAn] = /i 2 ,[/7]os,[n] + h 22 [n] o s 2 [n] 
We remark that the time index n and hence the frequency index iv, may be vectors. All results presented 
here holds also for vector valued time and frequency indecies, n and vv. As an example, consider the case where 
Sfln] and s 2 [n] are images, then the index n represents the location vector (n x ,n y ), and the index w represents 
the spatial frequency vector (w xi w y ) For simplicity of notations we shall always refer to scalar valued indecies. 

B. Cumulants and Polyspectra 

Let x 1t x 2 ,...,x* be a set of real valued random variables possessing the joint characteristic function: 

where / , and E{ } stands for the expectation operation. The joint cumulant of x k% is defined by: 



{ \ ( \k O k ln<t>(w) 

cum{x u x 2 ,....,x k ) = (-j) 



dwidw 2 ...dwk 



where ln( ) stands for the natural logarithm. We note that if x lf x 2 ,... are zero mean then 
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cum(xi) = E{xx] — 0 

5 cum(ii,ij) = E{x\X2\ 

cum(xi,x 2 ,r 3 ) = £{xiX 2 x 3 } 

cwm(xi t X2,X3,x 4 ) = £{xix 2 x 3 x 4 } - E{xix 2 }E{x 3 x < } 

10 - £{x 1 x 3 }JEJ{x 2 x 4 } - E{xix 4 }E{xix 3 } 

The following properties can easily be verified: 
15 (p.1) Linearity: cum(..., I, o,X/...) = £ j b j c(//n(...,x /f ...) 

(p.2) If Xi x* can be divided into two or more statistically independent subsets, then 

cum(x u ».,Xt<) ~ 0 

(p.3) If x 1( ... ,x k are jointly Gaussian then 

cum(xi x k ) = 0 

20 whenever k > 2. 

Let x Q [n] y Xi[n] x k [n] be jointly stationary discrete-time random processes. Then, their joint k-order 

spectrum (polyspectrum), is defined by: 



25 
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We note that P XqXo (w) is the power spectrum of x 0 [n], P Xo x lf (w) is the cross-spectrum between x 0 [n] and 
30 "* x^[n] t P Wo (w u w 2 ) is the second-order polyspectrum, or bispectrum, of x Q [n] f P XoX , X2 (w u w 2 ) is the cross- 
bispectrum between the indicated processes, P XqXqXoXq {w^w 2 ,w 3 ) is the third-order polyspectrum, or trispec- 
trum, of x 0 [r?], etc. 

(p.4) If Xo[n],Xi[n] xjn] can be divided into two or more statistically independent subsets of processes, 

then by (p.2) 

P^x, ^(Wl w 2 ...,w k ) = 0 

(P-5) If x 0 [n],x 1 [n] ( ...,x /£ [n] are jointly Gaussian then by (p.3) 

P* 0 ,x x,(wi,w 2 w k ) = 0 

whenever k is 2. 

40 (p.6) Transition of polyspectra through multi-input-multi-output LTI system: Let 

k 

y.-W = 5Z fc yW°*i[ n l i = o,i,...,/ 

j=0 



where h^n] is the unit sample response of a stable SISO LTI system whose frequency response is 
H /; <iv). Then, 

io=o ii=o t=v 

Summary of the Invention. 

The invention proposes an approach to estimate a plurality of input source signals, which passed through 

4 
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an unknown system. It suggests, in fact, a solution of the problem of signal separation from their coupled ob- 
servations. In the two channel case, the invention suggests an approach to estimate the desired signal (i.e., 
to cancel the interfering signal) or to estimate both source signals. 
s In the above-cited Patent Application Serial No. 07/750.917, it is suggested to separate and recover the 

input (source) signals by imposing the condition that the reconstructed signals be statistically uncorrelated. 
As it turns out, this condition is insufficient to uniquely solve the problem, unless we make certain assumptions 
concerning the unknown channel, e.g. that it is a 2 x 2 FIR filter. In order to solve the problem without any 
restrictive assumptions concerning the unknown channel, it is further suggested in that patent application to 

10 use high order statistics (e.g. polyspectra). In this invention we develop this approach, and find sufficient con- 
ditions involving cross-bispectrum, or cross-trispectrum, or any higher-order non-zero cross-polyspectra of the 
reconstructed signals. By imposing these conditions, we obtain a class of criteria for signal separation. 

According to the present invention, there is provided a signal processing system, comprising: a plurality 
of detectors for detecting signals, each detector receiving signals from plural sources; and a processor for re- 
ts ceiving the detected signals and producing a reconstruction filter for filtering the detected signals to produce 
reconstructed source signals in which each source signal is reconstructed without interference from the other 
source signals; characterized in that the reconstruction filter is produced such that cross-polyspectra of the 
reconstructed signals are forced to approach zero. 

More particularly, the invention comprises a signal processing system including a plurality of detectors for 

20 receiving plural observed signals, which results from plural source signals subjected to said system. A proc- 
essor receives the observed signals, and produces a reconstruction filter such that some cross-polyspectra 
of the reconstructed signals are zero, or near zero. The main idea of this invention is to impose conditions on 
the reconstructed signals using their cross-polyspectra. These conditions cause the reconstructed signals to 
be statistically independent. If the reconstructed signals are statistically independent it implies that the source 

25 signals, which became statistically dependent in the observation due to coupling, are separated at reconstruc- 
tion. The proposed method is universal in the sense that no assumptions are made about the source signals, 
except that they are statistically independent. 

If one transfer function (or unit sample response) of the reconstruction filter is known, then the other trans- 
fer function (or unit sample response) can be estimated. 

30 In another related embodiment, the processor that produces the reconstruction filter is adaptive. The proc- 

essor updates the components of the reconstruction filter as more data is available, and based on the previous 
estimate of the input source signal. This embodiment represents a class of possible algorithms of various meth- 
ods for sequential updating of the reconstruction filter. 

One application of the invention would be in a signal enhancing scenario in a room. The first microphone 

35 is located near the speaker and the other microphone is located near the noise source. The first microphone 
detects the desired speech signal with some noise, and the second microphone detects the noise with some 
speech signal. The coupling is due to the unknown acoustic room environment. The processor of the invention 
is used to reconstruct the desired speech signal without the interfering noise. When the second signal source 
is another speaker, the processor of the invention separates both speech signals from the detected micro- 

40 phone signals that contain their coupled measurements. In the context of speech signals, the invention proc- 
essor can be used as a front-end in automatic speech recognition systems operating in noisy environments, 
or when there is a cross-talk from an interfering speaker. 

Although in the above examples we mainly discussed speech enhancement problems, the system for mul- 
ti-channel signal separation can be applied to many different areas. For example, separating several mixed 

45 images, cancellation of noise signals in telemetry system. Also, superimposed/interfering signals in an antenna 
system can be separated/canceled using the proposed methods. 

The above and other features of the invention including various novel details of construction and combin- 
ations of parts will now be more particularly described with reference to the accompanying drawings and point- 
ed out in the claims. It will be understood that the particular choice embodying the invention is shown by way 

so of illustration only and not as limitation of this invention. The principles and features of this invention may be 
employed in various and numerous embodiments without departing from the scope of the invention. 

Brief Description of the Drawings. 

55 Figure 1 is a schematic illustration of a general signal processing system embodying the present invention. 

Figure 2 illustrates a general two channel LTI system where Hjj{w) ij =1,2 represent the transfer function 
of four SISO systems. 

Figure 3 illustrates the LTI two channel signal separation problem. 
Figure 4 illustrates the equivalent forms of the unknown system. 

5 
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Figure 5 illustrates one possible structure of the reconstruction system. 

Figure 6 illustrates the LTI two channel signal separation problem in the presence of additive noise. 

Figure 7 illustrates an embodiment of the signal processing system that implements an iterative process 
for estimating the coupling systems. 

Figure 8 illustrates a speech enhancing and noise cancellation system using the signal processing circuit 
of the invention. 

Figure 9 illustrates a signal enhancing system in an underwater acoustic environment. 
Figure 10 illustrates a tapped delay line (an FIR filter). 

Detailed Description of the Invention. 

In the two channel case, the basic problem of interest is illustrated in Figure 3. We observe the outputs 

y^[n] and y 2 [n] of an unknown 2x2 stable LTI system H whose inputs are s^[n] and s 2 [n], and whose frequency 
response is: 



20 



Hu(w) H l2 (w) 
Hn{w) H 22 (w) 



(1) 



25 



where H 0 {w) is the frequency response of the system from input sj[n] to output y,{n]. 

We wish to recover the input signals by using a 2 x 2 reconstructing filter g , adjusted by the processor, 
whose outputs are denoted by v^n] and v 2 [n] y and whose frequency response is: 



30 



(2) 



35 



Thus, if we denote by 



the frequency response of the combined system, then we want to adjust the components of G((w) so that T{(w) 
is of the form: 



40 



T„(ii») 0 
0 T 22 (w) 



(3) 



45 



or of the form: 



50 



0 Ti2(w) 
T 2l (w) 0 



(4) 
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If we further require that T u (w) = T^w) = 1 Vw in (3), or that 7 12 (w) = 7 21 (w) = 1 Vw in (4), then in the 
first case we have v^[n] = s,[n] and v 2 [n] = s 2 [n], in the second case v^n] = s 2 [n] and v 2 [n]~ s^[n], and the 
input signals are exactly recovered. However, since our main goal is the separation of the input signals, it may 
be sufficient to eliminate the cross-coupling effects and to recover s t [n] and s 2 [n] up to shaping filters. If we 
want to solve the remaining single-channel deconvolution problems (i.e., to force 7 n (w) = T&iw) = 1 Viv in (3), 
or T 12 (w) = T 21 (w) = 1 Viv in (4)), we need to have some prior knowledge concerning the nature of s^[n) and 



6 
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s 2 [n], tnat the y are sequences of independent identical distributed (Li.d.) random variables with known 
average power. 

By straightforward matrix multiplication we find that 

T{w) = g{w)H{w) : 



w 



15 



25 



is of the form of (3) if 



and it is of the form of (4) if 



G u (w)H, 2 (w) - G^MH^w) = 0 (5) 
- G 21 (w)H 1l (w) + G 22 (w)H 21 (w) = 0 (6) 



Gn(w)H,i(w) - G 12 (w)H 2l (") = 0 (7) 
- G 2 ,(w)H, 2 (w) + G 22 (w)H 22 (w) = 0 (8) 
Clearly, there are infinitely many combinations of G }} {w) ij = 1,2 that satisfy the equation pair (5) (6), or 
the equation pair (7) (8). Therefore, we may arbitrarily set G in and G^ to be unity transformations, i.e. 

G 11 (w) = G 22 (w) = 1 Viv (9) 
and only adjust the decoupling filters G 12 and G 21 . In this case, the solution to (5) (6) is given by: 



Gl2(w) -^' G21(VV) "7^' 



20 and the solution to (7) (8) is given by: 



(10) 



(11) 



30 



These solutions should be expected since if s,[n] and s 2 [n] are statistically independent, then s^[n] through H u 
and s 2 [n] through H 22 , or s^[n] through H 21 and s 2 [n] through H 12 , are also statistically independent. Therefore, 
based on the statistical independence condition, we can only identify the pair H 12 //-/ 22 and H 21 /H 11( or the pair 
H u /H 21 and H^/H^ as illustrated in Figure 4. Of course if H,y/,y=1 ,2 were known then by setting the decoupling 
systems G 12 and G 21 to satisfy (10) or (11), we obtain the desired signal separation. However, since H,y are 
unknown, we need to find a method or criterion that blindly yields one of the desired solutions. 
We note that we may use a reconstruction system of the form: 



35 



1 -Gi 2 (™) 
-G 2x {w) 1 



(12) 



A possible realization of this scheme is shown in Figures. If we have found the solution in (10), then T u (w) = 
H u (w) and T&iw) = H&iw), and we have exactly recovered the signals that would have been measured in each 
sensor in the absence of the other source signal. Similarly, if we have found the solution in (11) then 7" 12 (w) 
= H A2 (w) and T 21 (w) = H 21 (w), and once again we have recovered the signals that would have been measured 
separately, only that in this case we switch the terminals. This could be useful in many practical situations. 
For example, in the problem of separating competing speakers, if each speaker is located near a microphone 
then H u and H 22 are nearly unity in which case the original speech signals can be recovered with very little 
distortion. 

Figure 1 illustrates schematically the operation of the signal separator of the invention. Two signals s^[n] 

and s 2 [n] are processed by an environment 10 which is represented by a transfer function W . Figure 2 shows 

the transfer function 'H in more detail. The transfer function *H produces output signals y^[n] and y 2 [n]. The 

environment 10 represented by *H produces coupling or cross talk in both output signals y^[n] and y 2 [n]. The 
processor 14 and the reconstruction filter 12 operate under the criterion that the reconstructed source signals 
denoted by v^n] (or s[n]) and v 2 [n] (or s 2 [n]) t are forced to possess some zero cross high-order polyspectra. 

If the processor 14 adjust the decoupling systems G 12 (w) and G 21 (iv) so that two or more cross-polyspectra 
of orders k ^ 2 are zero or nearly zero then the frequency response 

T(v>) = G(w)H(w) < 

the combined system is of the desired form (3) or (4), and the signals are separated and recovered up to shap- 

7 
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ing filters. 

A. Estimation based on the cross-bispectrum (3rd-order cross-cumulants) and the cross-trispec- 
5 trum (4th-order cross-cumulants). 

We shall now concentrate on criteria and algorithms obtained when using our approach with cross- 
poiyspectra of order k ~ 2, that is the bispectrum and of order k = 3 that is the trispectrum. 
It can be verified that if the processor 14 adjusts the reconstruction filter 12 so that: 
10 P Wa (wi,w 2 ) = 0 Vw 1f w 2 (13) 

Pv 2 v 2Vl (Wi,w 2 ) = 0 Vw u w 2 (14) 

then T (w) must be in the form of (3) or (4). In fact, it is sufficient that (13) and (14) holds only for a partial 
set of frequencies, e.g., - k < Wi ^ n, w 2 = 0. 

The cross-polyspectra of the reconstructed signals can be expressed in terms of the components G 12 (w) 
and G 21 (w) and thepolyspectra of the observed (measured) signals. We obtain (several, at least) two equations 
that can be solved explicitly in the frequency or the time domains, to find the desired decoupling filters G 12 (w) 
and G 21 (iv). 

We shall now concentrate on time domain algorithms which evolve from (13) (14). For that purpose we let 
G 12 and G 2 i be casual finite impulse response (FIR) filters (see Figure 10) of the form: 

25 

<?2l(«0 = f>«~ iU * ( 16 ) 
Jk=0 

30 

where and q 2 are some pre-specified filter orders, in which case the reconstructed signals v^[n] and v 2 [n] 
are given by: 



9i 
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v\[n) = yi[n] - a k y 2 [n - k] (1?) 



vi[n] = V2[n) - b kVi[ n ~ k ) ( 1S ) 

Jfc=0 

In this setting the problem is reduced to that of adjusting the filter coefficients a k 's and b k 's to satisfy the 
selected criterion equations. 

Consider first the criterion suggested by (13) (14). Inverse Fourier transforming the equations 
cum(v i[n],vi[n - t^, v 2 [n - x 2 ]) = 0 VT lf T 2 (19) 
cum(v 2 [n], v 2 [n - t^, v,[n - t 2 ]) = 0 Vt,,t 2 (20) 
Substituting (18) into (19), and (17) to (20), we obtain: 



a k cum(v 2 [n],v 2 [n - r x ], y 2 [n - r 2 - k]) - 



Jt=o 



= cum{v 2 [n],v 2 [n - r^y^n — r 2 ]) Vri,^ (21) 



8 
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Y^ b k c«m(vi[n], Vi[n - r^y^n - r 2 - A]) = 



= cum(v t [n],vi[n - n], yj[n - r 2 ]) Vri,r 2 (22) 

Since the cumulants are unknown, they are approximated by their sample estimates. Assuming for sim- 
plicity that Sj[/7] / = 1,2 are zero mean, 

cum(vi[nlvi[* ~ T i]*vA n ~ T * ~ *D = E{vi[n)vi[n - nhtfn - r 2 - *]} 

AT 



«^ Vi[n]vi[n - ra] W [Ti - r 2 - *] t,i € {1,2} (23) 

n= 1 



Since (21) and (22) are satisfied for all combinations of x^ and t 2 , we have an overdetrmined set of equa- 
tions to solve for the a fc 's and b k 's. Writing (21) (22) in matrix form for some values of t 1( t 2 (e.g., I x^ I , | t 2 | ^M, 
for some positive integer, M), we obtain: 
20 M b a = v b (24) 

M~ a b = v t (25) 

where the ith row of the matrix M b is 

M b i = [cum(v 2 ln], v 2 [n - x u ],y 2 [n - t^]), .., cum(v 2 [h\ % v 2 [n - x y ],y 2 [n - x^ - q1])]x^ x 2 i e B, (26) 
the /th element of the vector v b is 
25 V = cu/T7(v 2 [n],v 2 [n - x u ]^[n - t^]) Ma e B, (27) 

and similarly the ith row of the matrix M a is 

MJ = [cum{v A [n] t Vi[n - x^yjn - ~t 2/ ], .., ctym(^[n], ^[n - x^yjn - - q 2 ])] *v e S, (28) 
and the / th element of the vector v a is 

v a i = cu/n^n], ^[n - x^ly 2 [n - t 2/ ]) x 1/f x^ e B (29) 
50 for some preselected set of Integers B. The form of equations (24) (25) suggest an iterative algorithm in which 
we alternate between solving (24) for the a*'s using the current b k '$, and solving (25) for the b k 's using the 
current a* s. Each iteration cycle involves the solution to a standard linear least squares problem. 

The flow chart in Figure 7 illustrates the iterative algorithm which estimates a and b iteratively using Equa- 
tions (24) (25). Then generating v^[n] and v 2 [n] using the new a and b according to (17) and (18), respectively. 
35 Block 110 illustrates the setting of the initial estimates of a and b and setting the iteration index k to zero. As 
shown in block 112, v^[n] and v 2 [n] are calculated using a<*> and 6<*> and the detected signals, y^n] and y 2 [n], 
in accordance with equations (17) (18), respectively. The value v A [n] is used to compute the cumulant estima- 
tors required for the construction of M £ and v& in block 114. In block 116 the new value for b is computed by 
solving the least squares problem of (25), i.e., 
40 i> = /trWM a )- 1 MlWv a . (30) 

where W \s a prespecified weighting matrix. In block 118 the value v 2 [n] is used to compute the cumulant es- 
timators required for the construction of M b and v bf and in block 120 the new value for a is computed by solving 
the least squares problem of (24), i.e., 

a<* + D = M[WM b )^ MlWv b . (31) 
Block 122 determines whether convergence has occurred. If more iterations need to be calculated, k is set 
equal to k + 1 and calculation are restarted in block 112. If convergence has occurred, the values for a<* +1 > and 
6<* + d are set equal to gi 2 [n] and g 2 i[n], respectively. Where g l} [n] are the unit sample response of G i} {w) ij= 1, 
2 / * / The estimators of the input signals are now computed using g 12 [n] and g 21 [n] in Block 128. 

Now we shall derive similar algorithms based on the trispectrum or the 4th-order cross-cumulants . It can 
be verified that if the processor 14 adjusts the reconstruction filter 12 so that: 

P Wi* a ( W 1' W 2' W 3) = 0 V w u w 2 ,w 3 (32) 
(Wi,w 2 ,iV3) = 0 V w u w 2 ,w 3 (33) 

55 then T{(w) must be of the form of (3) or (4). In fact, it is sufficient that (32) and (33) holds only for a partial 
set of frequencies, e.g., - n < = w 2 ^ n t vv 3 = 0. 

Inverse Fourier transforming the criterion suggested by (32) (33) and using (17) and (18), we obtain: 
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$3 a k cum(v 2 [n],v 2 [n - r l },v 2 {n - r 2 ),y 2 [n - r 3 ~ k]) = 



= cum{v 2 [n),v 2 {n - r x ],v 2 [n - T 2 } y y v [n - r 3 ]) Vr lt r 2) r 3 (34) 



45 



55 



Q2 

Yl bk cum(vi[n], vi[n - n],^^ - r 2 ] t yi[n - r 3 - *]) = 

Ar=0 

= cum(vi[n]tVi[n - r^vifn - r 2 ],y 2 [n - r 3 ]) Vr^^^ (35) 



Since (34) and (35) are satisfied for all combinations of , t 2 and t 3 , we have an overdetrmined set of equations 
15 to solve for the a^'s and b k 's. Writing (34) (35) in matrix form for some values of t,, t 2 , t 3 (e.g., I t 1 L I x 2 1 , 1 x 3 1 
^ M, for some positive integer, M), we obtain: 

M b a = v t (36) 
M' a b = v a (37) 

Once again, the form of these equations suggests an Fterative procedure in which we substitute the current 
20 values of b k 's in (36) to obtain a new set of a k 's and the current values of a^'s in (37) to obtain a new set of 
b k 's. Each iteration cycle involves the solution to a standard linear least squares problem. Of course, in the 
actual implementation of the algorithm the cumulants appearing in (34) and (35) are substituted by their sample 
estimates. 

We may combine several pairs of criterion equations in order to improve statistical stability. It is straight- 
25 forward to devise an algorithm in which we iteratively solve the combined (21) and (34) for the a*'s, and the 
combined (22) and (35) for the b k s. We may assign different weights to different equations (i.e., using a weight- 
ed least squares solution) to reflect the statistical variability of say third-order empirical cumulants to fourth- 
order empirical cumulants. 

The above algorithms can easily be phrased in terms of any other cross high-order polyspectra (or cumu- 
30 lants). The processor 14 of Figure 1 is aimed to produce a reconstruction filter 12 so that its outputs possess 
some high-order cross-polyspectra near zero. 

B. Combining the Decorrelation Criterion. 

35 We may also consider incorporating the decorrelation criterion proposed in the above-cited Patent Appli- 

cation Serial No. 07/750.917, with our proposed criteria. The decorrelation condition requires that the recon- 
structed signals v } [n] and v 2 [n] be statistically uncorrelated, or that their cross-spectrum be identically zero, 
that is 

P, t v 2 (w) = P y , y2 {w) - G, 2 (w)P y2y2 (w) • G; A (w)P y ^{w) + G , 2 ( w) G;, ( w) Py^ ( w) 0 Vw (38) 
40 where (■)* denotes complex conjugation. 

Note that this equation does not specify a unique solution for both G 12 and G 21 . For any pre-specif ied G 21 
we can find G 12 that satisfy the equation, and vice versa. 

To combine the decorrelation equation with the other criterion equations, we rewrite (38) in the following 
two alternative forms: 



G {w) = Py,yA») ~ S»(w)P w (w) = P y<Vl (w) 

Py,y,M ~ G 2 *, (*v) P y2j ,, ( w) P y ^ (w) 

g 21 (w) = p ™ (w) - G ^ w)p y*W . P m W (40) 

Py,y,M ~ G; 2 (w)P m (*0 P y , v , (iv) 



50 Transforming (39) and (40) into time domain: 



£ a k cum(v 2 [n}, ^[n - r - *]) = cum(v 2 [n], y x [n - r]) Vr 
Jb=o 

^b k cum(vi[n],yi[n - r - k]) = curn(v x [n] t y 2 [n - r]) Vr 



(41) 
(42) 
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It is straightforward to incorporate these equation with any of the proposed criterion equations, e.g. iterating 
between solving (21) jointly with (41) for the a^s, and solving (22) jointly with (42) for the b k '$. Once again, we 
may assign different weights to different criterion equations so as to reflect the statistical variability of second 
order empirical cumulants (correlations) to higher-order empirical cumulants. 

C. Recursive/Sequential Algorithms. 

In a variety of applications, it is desirable to process the data recursively/sequentially. The advantage of 
a recursive/sequential algorithm over a batch algorithm is not necessarily in the final result, but in the compu- 
tational efficiency, reduced storage requirements and in fact that an outcome may be provided without having 
to wait for all the data to be processed. Moreover, if the underlying system (channel) exhibit time changes, 
processing all the available data jointly is not desirable, even if we accommodate the computational and storage 
load of the batch algorithm, since different data segments correspond to different channel responses. In that 
case we want to have an adaptive algorithm that is capable of tracking the varying characteristics of the chan- 
nel. 

Concatenating the equations in (21) for Xi = 0 and t 2 = 0,1,2,...,q 1 and the equations in 22 for = 0 and 

t 2 = 0,1 ,2 q 2 (so that the number of equations is equal to the number of unknown parameters), and assuming 

for simplicity zero means processes, we obtain: 

E{v 2 [n)v 2 [n]y£n]}a = E{v 2 [n\v 2 {n] yi {n]} (43) 

E{v,[n]v,[n]yJ\n]}b = E{v,[n]vdn]y 2 [n]} (44) 

where 

yifn] = (yi[n] y,[n - q 2 ]V (45) 

liln] = (y 2 [n] y 2 [n - Qi]) r (46) 

v,[n] = <v 1 [#i],...,iMn - QiV (47) 

v 2 [n] = (v 2 [n] v 2 [n - qi ]) T (48) 

Replacing expectations with sample average suggested by (23), we obtain the following iterative-recursive 
algorithm: 

aO(n) = af>(n - 1) + y n Q(n)v 2 [n]v 2 [n]v,[n]\ a = f «* (n . , )tb _ = ^> (49) 

where 



7nQ(n - l)v 2 [n}v 2 [n]y^[n]Q(n - 1) 



g(n) " 1 - In [ Q(n 1} (1 - 7n) + 7ngln]Q(n - l)v 2 [n]v 2 {n] 



(50) 



W(n) = - 1)+ YnQ(n)v,[n]v,[n]v 2 [n]\ a = ^u b = l ^-u (51) 



where 



l-7n 



R(n - 1) - 



(1 - In) + 7n£f [n}R(n - l^n^n] 



(52) 



where y n = 1/n, and aW(n) and b&(n) are the values of a and b at the /th iteration of the algorithm, based on 
sample averages to time n. The input to the /th iteration cycle are the values and b^ 1 > from the previous 
iteration cycle. Then using (49)-(52), the next iteration cycle is performed recursively in n. 

If instead of ierating we use the most current values of a and b along the recursion, we obtain the following 
sequential algorithm: 

a(n) = a(n - 1) + YnQi^v&nty&ntyM I « = f( n - v.b = b(n- n (53) 
b(n) = b(n - 1) + YnRWvAnfrMvAn] \ a . a(n . 1)f/3 ,6 (n . t) (54) 
where a(n) and b(n) are the values of a and b at time n, and where Q(n) and R(n) are computed recursively 
using (50) and (52), respectively. 

An alternative approach for generating a sequential algorithm, is based on first-order stochastic approxi- 
mation methods. The resulting algorithm is: 

a(n) = a(n - 1) + 7n^]^h[n]l asf(fl . i>, ? = *<n- n (55) 
b(n) = b(n - 1) + y^[n]^[n]v2[/i]|; = a(/I . i>,b = 6<„- u (56) 
If we choose y„ = y (a constant), it corresponds to exponentiil weighting "that reduces the effect of past data 
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relative to new data, and we effectively obtain an adaptive algorithm that is capable of tracking the varying 
characteristics. of the channel. 

The algorithm in (53) (54) can be viewed as the equivalent of the Recursive Least Squares (RLS) algorithm 
for the problem in hand, while the algorithm in (55) (56) can be viewed as the equivalent of the Least Mean 
Squares (LMS) algorithm. We note that similar iterative-recursive and sequential algorithms can be developed 
for solving the other criterion equations. The possibility of combining several recursive/sequential algorithms 
corresponding to different criteria equations also exists here. 

D. Effect of Additive Noise. 

Consider the system illustrated in Figure 6 in which the observed signals y,[n] and y 2 [n] are contaminated by 
the additive noises w^n] and w 2 [n] respectively. Then the outputs of the reconstruction filter can be represented 
as sum of contributions due to the signal and the noise, i.e. 

Vi[n] = v< st [n] + ^[n] i = 1 ,2 (57) 

Assuming that s t {n] / = 1,2 and w,{n] / = 1,2 are statistically independent, 

v - v -.( w 1 f w 2 ) (58) 

where by (p.6) 

2 2 2 

? (w ) ( w) ( w)(^i,ti;2) = YH2Y1 G k(- Wi - m)Gi j (wi)G2k(w 2 )Py fi w J w k (w l ,w 2 ) (59) 

If w^n] and w 2 [n] are statistically independent then all terms of the triple sum in (59) are zero except for / 
= j~ k. However, we note that w^n] and w 2 [n] may be statistically dependent, e.g. they resultfrom a directional 
interference. If the auto and cross bispectra of the additive noises are known a-priori, or can be measured in- 
dependently, then P v ^w) Vt (w) V2 (w)(w u w 2 ) can be calculated separately and then subtracted from (58). Similar 
subtraction operation can be performed with respect to all other criterion equations. 

In the special case where w-j[n] and w 2 [n] are jointly Gaussian then by (p.5) all their polyspectra of order 
k > 2 are zero, in particular 

P^w k (w u w 2 ) = 0Vw 1f tv 2 (60) 
for all combinations of ij\k e {1 ,2}. Therefore, all the proposed criteria are unaffected (blind) to additive Gaus- 
sian noise. An exception is the decorrelation criterion of the above-cited Patent Application Serial No. 
07/750.917 which may be sensitive to correlated Gaussian noises. 

In the actual implementation of the algorithms the polyspectra, or the respective cumulants, are substituted 
by their sample estimates. Therefore, the effect of additive noise is non-zero even in the Gaussian case, and 
the empirical cross-polyspectra between v/ s >[n] and v,M[n] /= 1,2 are also non-zero. 

The algorithms previously derived are examples and are not limiting, but merely representative of our gen- 
eral approach in which the signal processing device of the invention can be used. 

Figure 8 illustrates the use of the invention in a speech enhancing and noise cancellation system. The sep- 
aration of voice signals from interfering noise signals in a room can be easily accomplished using the signal 
processing device of the invention. For example, Figure 8 illustrates an individual 61 in room 57. Also in the 
room is a noise source 60, such as a TV or a radio. Microphone 54 is located near the noise source 60. Micro- 
phone 56 is near the desired signal source from the individual 61 . Due to the room acoustics, both signals are 
picked up by both microphones. The processing and reconstruction device 58 operates on the detected signals 
in accordance with the principles described above.. Thus, the desired signal from source 61 can be derived. 
The desired signal reconstructed from 58 can then be processed by speech recognition device 63. 

The signal separator of the invention can also be used in a moving vehicle, such as a car. A microphone 
can be located near the muffler and another microphone near the speaker. The speaker's microphone could 
be a car phone. The noise caused by the muffler can be eliminated by using the signal separator of the inven- 
tion. Moreover, since some of the generating transfer functions are known or can be calculated from the car 
acoustical environment, calculations can be simplified in the reconstruction filter. 

Figure 9 illustrates a signal enhancing system in accordance with the invention in an underwater acoustic 
environment. A sonar array 64 is used to determine the position of target 66. Noise generated by propeller 70 
interferes with this determination. Accordingly, microphone 62 generates an output signal which is processed 
with the signal from array 64 by signal separation device 68 and an accurate target signal can be calculated. 

Those skilled in the art will recognize, or be able to ascertain, using no more than routine experimentation, 
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many equivalents to the specific embodiments of the invention described herein. These and all other equiva- 
lents are intended to be encompassed by the following claims. 

Claims 

1. A signal processing system comprising: a plurality of detectors for detecting signals, each detector receiv- 
ing signals from plural sources; and a processor for receiving the detected signals and producing a re- 
construction filter for filtering the detected signals to produce reconstructed source signals in which each 
source signal is reconstructed without interference from the other source signals; characterized in that 
the reconstruction filter is produced such that cross-polyspectra of the reconstructed signals are forced 
to approach zero. 

2. A signal processing system according to Claim 1, wherein the number of detectors and sources is two, 
and the reconstruction filter is adjusted so that the following polyspectra of the reconstructed source sig- 
nals v^[n] and v 2 [n] at the output of the reconstruction filter approach zero: 

^w 2 (wi.W2) = 0 (wi,w 2 ) e Cl 2 

Pv 2 v 2 v^ W 2) = 0 (W U W 2 ) € a 2 

where Q 2 is a preselected frequency region. 

3. A signal processing system according to Claim 1, wherein the number of detectors and sources is two, 
and the reconstruction filter is adjusted so that the following polyspectra of the reconstructed source sig- 
nals v,[n] and v 2 [n] at the output of the reconstruction filter approach zero: 

*W lVa (w 1t w 2 .W3) = 0 (w 1t w 2 ,w 3 ) e ^ 3 

where Q 3 is a preselected frequency region. 

4. A signal processing system according to Claim 2, wherein the reconstruction filter is adjusted so that the 
following polyspectra of the reconstructed source signals v^[n] and v 2 [n] at its output approach zero: 

PvwtoiWuWziWs) = 0 {w u w 2 ,w 3 ) e Q 3 
p v 2 v 2 v 2 v,(wi,w 2 ,w 3 ) = 0 (w u w 2 ,w 3 ) e Q 3 
where £} 3 is a preselected frequency region. 

5. A signal processing system according to Claim 2, wherein the reconstruction filter is adjusted so that the 
following cross- spectrum of the reconstructed source signals v^[n] and v 2 [n] at the reconstruction filter 
output approaches zero: 

where Q is a preselected frequency region. 

6. A signal processing system according to Claim 3, wherein the reconstruction filter is adjusted so that the 
following cross-spectrum of the reconstructed source signals v^[n] and v 2 [n] at the reconstruction filter 
output approaches zero: 

Pv,v 2 (w) = 0 iv e n 
where Q is a preselected frequency region. 

7. A signal processing system according to Claim 4, wherein the reconstruction filter is adjusted so that the 
following cross-spectrum of the reconstructed source signals and v 2 [n] at the reconstruction filter 
output approaches zero: 

Pv t v t (w) = 0 w e O 
where Q is a preselected frequency region. 

8. A signal processing system according to Claim 2, wherein the reconstruction filter is adjusted so that the 
following cumulants of the signals v^[n] and v 2 [n] at its output approach zero: 

cum(v,[n], v^n - v 2 [n - xj) = 0 (T 1t x 2 ) e S 2 
cum(v 2 [n], v 2 [n - x n ], v,[n - xj) = 0 (x 1t x 2 ) g B 2 
where B 2 is a preselected set of integers. 
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9. A signal processing system according to Claim 3, wherein the reconstruction filter is adjusted so that the 
following cumulants of the signals v^[n] and v 2 [n] at its output approach zero: 

cummin], v % [n - x^, v,[n - x 2 ], v 2 [n - x 3 ]) = 0(x 1f x 2 ,x 3 ) e B 3 
cum(v,[n], v,[n - xj, v^[n - x 2 ], v 2 [n - x 3 ]) = 0 (x 1f x 2 ,x 3 ) e B 3 
where S 3 is a preselected set of integers. 

10. A signal processing system according to Claim 8, wherein the reconstruction filter is adjusted so that the 
following cumulants of the signals v^[n] and v 2 [n] at its output approach zero: 

cummin], v y [n - x^, v^[n - x 2 ], v 2 [n - x 3 ]) = 0 (x-i ,x 2 ,x 3 ) e B 3 
cummin], v,[n - xj, v,[n - x 2 ], v 2 [n - x 3 ]) = 0 (x 1f x 2 ,x 3 ) e 8 3 
where B 3 is a preselected set of integers. 

11. A signal processing system according to Claim 8, wherein the reconstruction filter is adjusted so that the 
following cumulants of the signals v^[n] and v 2 [n] at the reconstruction filter output approach zero: 

cum(v^[n], v 2 [n + x]) = 0 x <= B 
where S is a preselected set of integers. 

12. A signal processing system according to Claim 9, wherein the reconstruction filter is adjusted so that the 
following cumulants of the signals Vi[n] and v 2 [n] at the reconstruction filter output approach zero: 

CL/m(v 1 [n] l v 2 [n + x]) = OteS 
where B is a preselected set of integers. 

13. A signal processing system according to Claim 10, wherein the reconstruction filter is adjusted so that 
the following cumulants of the signals v^[n] and v 2 [n] at the reconstruction filter output approach zero: 

cummin], v 2 [n + x]) = 0 x <= B 
where B is a preselected set of integers. 
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